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DETAILED ACTION/ 

1. This Non-Final action is responsive to the RCE filed on 10/31/2007 and the IDS filed 11/1/2007. 

2. In the RCE Claims 1-21 are pending. Claims 22-25 are canceled. Claims 1, 9, 15 and 19 are the independent claims. 

Withdrawn Rejections 

3. The 35 U.S.C. 103(a) rejections of claims 1-21 with cited references of Echo (NPL, FLASH VS JAVA APPLETS) in 
view of Moock (NPL, The Art of Flash 5 Preloading) Further in view of Chun (NPL, Flash 5 Advanced for Windows and 
Macintosh: Visual QuickPro Guide) has been withdrawn in light of the amendment. 

Information Disclosure Statement 

4. The information disclosure statement (IDS) submitted on 1 1/1/2007 has been entered, and considered by the examiner. 

Claim Rejections - 35 USC § 103 

5. The following is a quotation of 35 U.S.C. 103(a) which forms the basis for all obviousness rejections set forth in this 
Office action: 

(a) A patent may not be obtained though the invention is not identically disclosed or described as set forth in section 
102 of this title, if the differences between the subject matter sought to be patented and the prior art are such that the 
subject matter as a whole would have been obvious at the time the invention was made to a person having ordinary skill 
in the art to which said subject matter pertains. Patentability shall not be negatived by the manner in which the 
invention was made. 

6. Claims 1-21 are rejected under 35 U.S.C. 103(a) as being unpatentable over Pumaveja (U.S. 6,006,241, filed on Mar. 
14, 1997) in view of Sani (NPL— Java Applets #4, April 1998, irt.org, pgs 1-6). 

Regarding Independent claim 1, A method of displaying a markup document and a linked applet within the markup 
document, the method comprising: Delaying display of image output information for the markup document using 
image output delay information used to delay display of the markup document, and included in the applet or the 
markup document; and Synchronizing the delayed image output information for the markup document with applet 
output information for the applet linked to the markup document, when rendering of the applet is completed, such that 
the delayed image output information for the markup document and the applet output information for the applet are 
displayed simultaneously , wherein the applet is formed using the Java programming language . 
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Purnaveja teaches the synchronized display of textual/graphical HTML data with Java applets (see abstract & column 
2, lines 40-55). He teaches the delay of markup image/audio data by using a decoder which buffers the markup data 
(see fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58). He states that "Further, since the video 
and annotation streams are handled synchronously but separately by video decoder 964 and annotation interpreter 
963, respectively, steps 1040 and 1050 can occur concurrently ..."(see column 9, lines 34-40). Although Purnaveja 
provides a reasonable suggestion for simultaneous display of HTML data with applets he fails to teach the use of delay 
functions within the applet for delaying applet data, instead relying on the interpreter/decoder to display both data 
concurrently further using time markers to display data at a predetermined time, thus including attributes to delay 
markup data display. Sani teaches the use of common Java Applet functions that include delay/suspending of applet 
data (see pg 2, paragraphs 1 & 3 & pg 3, paragraphs 1-2 & pg 4, paragraphs 1-2). He also describes the common applet 
execution states for start, stop and destroy operations using functions (see pg 2, paragraphs 1 & 3). At the time of the 
invention it would have been obvious for the skilled artisan to have implemented the common delay/suspend Java 
applet functions of Sani with the invention of Purnaveja. The motivation for doing so would have been to continuously 
display HTML and applet data concurrently thereby providing information in an integrated seamless package to client 
computers. 

Regarding Dependent claim 2, with dependency of claim 1, Purnaveja teaches wherein the delaying of the display of 
the image output information for the markup document comprises buffering the image output information for the 
markup document (see abstract & column 2, lines 40-55 & fig 9 numerals 966-965 & column 9, lines 5-65, specifically 
lines 34-58, including the explanation provided in the independent claims). 

Regarding Dependent claim 3, with dependency of claim 1, Purnaveja teaches wherein the synchronously displaying 
the delayed image output information for the markup document and the applet output for an initial image of the applet 
comprises simultaneously providing the delayed image output information for the markup document and the applet 
output for the initial image of the applet to a display device based on an output control signal (see abstract & column 2, 
lines 40-55 & fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58, including the explanation 
provided in the independent claims). 



Regarding Dependent claim 4, with dependency of claim 1, Purnaveja teaches wherein the applet is formed of 
program codes having an output method different from that of the markup document (see abstract & column 2, lines 
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40-55 & fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58, including the explanation provided in 
the independent claims). 

Regarding Dependent claim 5, with dependency of claim 3, Purnaveja teaches wherein the output control signal is 
provided from an applet executing engine, which interprets the applet, or a presentation engine, which interprets the 
markup document (see abstract & column 2, lines 40-55 & fig 9 numerals 966-965 & column 9, lines 5-65, specifically 
lines 34-58, including the explanation provided in the independent claims). 

Regarding Dependent claim 6, with dependency of claim 1, Purnaveja teaches wherein the delaying of the display of 
the image output information for the markup document comprises buffering text output of the markup document and 
buffering at least one of an image output and an audio output of the markup document (see abstract & column 2, lines 
40-55 & fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58, including the explanation provided in 
the independent claims). 

Regarding Dependent claim 7, with dependency of claim 2, Purnaveja teaches wherein the buffering comprises 
buffering text output of the markup document and buffering at least one of an image output and an audio output of the 
markup document (see abstract & column 2, lines 40-55 & fig 9 numerals 966-965 & column 9, lines 5-65, specifically 
lines 34-58, including the explanation provided in the independent claims). 

Regarding Dependent claim 8, with dependency of claim 3, Purnaveja teaches wherein the delaying of the display of 
the image output information for the markup document comprises buffering text output of the markup document and 
buffering at least one of an image output and an audio output of the markup document (see abstract & column 2, lines 
40-55 & fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58, including the explanation provided in 
the independent claims). 

Regarding Independent claim 9, An information storage medium controlling a computer to display a markup 
document and a linked applet within the markup document, comprising: the markup document; and the applet linked to 
the markup document, wherein the applet or the markup document includes markup image output delay information - 
used to delay display of the markup document such that image output information of the markup document and applet 
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output information of the applet are synchronized to be displayed simultaneously , wherein the applet is formed using 
the Java programming language . 

Purnaveja teaches the synchronized display of textual/graphical HTML data with Java applets (see abstract & column 
2, lines 40-55). He teaches the delay of markup image/audio data by using a decoder which buffers the markup data 
(see fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58). He states that "Further, since the video 
and annotation streams are handled synchronously but separately by video decoder 964 and annotation interpreter 
963, respectively, steps 1040 and 1050 can occur concurrently .."(see column 9, lines 34-40). Although Purnaveja 
provides a reasonable suggestion for simultaneous display of HTML data with applets he fails to teach the use of delay 
functions within the applet for delaying applet data, instead relying on the interpreter/decoder to display both data 
concurrently further using time markers to display data at a predetermined time, thus including attributes to delay 
markup data display. Sani teaches the use of common Java Applet functions that include delay/suspending of applet 
data (see pg 2, paragraphs 1 & 3 & pg 3, paragraphs 1-2 & pg 4, paragraphs 1-2). He also describes the common applet 
execution states for start, stop and destroy operations using functions (see pg 2, paragraphs 1 & 3). At the time of the 
invention it would have been obvious for the skilled artisan to have implemented the common delay/suspend Java 
applet functions of Sani with the invention of Purnaveja. The motivation fordoing so would have been to continuously 
display HTML and applet data concurrently thereby providing information in an integrated seamless package to client 
computers. 

Regarding Dependent claim 10, with dependency of claim 9, Although Purnaveja provides a reasonable suggestion 
for simultaneous display of HTML data with applets he fails to teach the use of delay functions within the applet for 
delaying applet data, instead relying on the interpreter/decoder to display both data concurrently further using time 
markers to display data at a predetermined time, thus including attributes to delay markup data display, Sani teaches 
wherein the applet executes in any one state of an initial state, a start state, a stop state, and a destroy state (see pg 2, 
paragraphs 1 & 3 & pg 3, paragraphs 1-2 & pg 4, paragraphs 1-2, including the explanation provided in the 
Independent claims). At the time of the invention it would have been obvious for the skilled artisan to have 
implemented the common delay/suspend Java applet functions of Sani with the invention of Purnaveja. The motivation 
for doing so would have been to continuously display HTML and applet data concurrently thereby providing 
information in an integrated seamless package to client computers. 
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Regarding Dependent claim 11, with dependency of claim 9, Although Purnaveja provides a reasonable suggestion 
for simultaneous display of HTML data with applets he fails to teach the use of delay functions within the applet for 
delaying applet data, instead relying on the interpreter/decoder to display both data concurrently further using time 
markers to display data at a predetermined time, thus including attributes to delay markup data display. Sani teaches 
wherein the applet includes a delay function as the markup image output delay information for synchronizing display of 
image output information of the markup document with display of output information of the applet (see pg 2, 
paragraphs 1 & 3 & pg 3, paragraphs 1-2 & pg 4, paragraphs 1-2, including the explanation provided in the 
Independent claims). At the time of the invention it would have been obvious for the skilled artisan to have 
implemented the common delay/suspend Java applet functions of Sani with the invention of Purnaveja. The motivation 
for doing so would have been to continuously display HTML and applet data concurrently thereby providing 
information in an integrated seamless package to client computers. 

Regarding Dependent claim 12, with dependency of claim 10, Although Purnaveja provides a reasonable suggestion 
for simultaneous display of HTML data with applets he fails to teach the use of delay functions within the applet for 
delaying applet data, instead relying on the interpreter/decoder to display both data concurrently further using time 
markers to display data at a predetermined time, thus including attributes to delay markup data display. Sani teaches 
wherein the applet includes a delay function during the start state as the markup image output delay information for 
synchronizing display of image output information of the markup document with display of output information of the 
applet (see pg 2, paragraphs 1 & 3 & pg 3, paragraphs 1-2 & pg 4, paragraphs 1-2, including the explanation provided 
in the Independent claims). At the time of the invention it would have been obvious for the skilled artisan to have 
implemented the common delay/suspend Java applet functions of Sani with the invention of Purnaveja. The motivation 
for doing so would have been to continuously display HTML and applet data concurrently thereby providing 
information in an integrated seamless package to client computers. 

Regarding Dependent claim 13, with dependency of claim 10, Although Purnaveja provides a reasonable suggestion 
for simultaneous display of HTML data with applets he fails to teach the use of delay functions within the applet for 
delaying applet data, instead relying on the interpreter/decoder to display both data concurrently further using time 
markers to display data at a predetermined time, thus including attributes to delay markup data display. Sani teaches 
wherein the applet comprises: a delay function as the markup image output delay information, which delays display of 
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image output information for the markup document; and a delay cancel function canceling the delay of the display of 
the image output information for the markup document, when rendering of an initial image of the applet is completed 
by the initial and start states of the applet (see pg 2, paragraphs 1 & 3 & pg 3, paragraphs 1-2 & pg 4, paragraphs 1-2, 
including the explanation provided in the Independent claims). At the time of the invention it would have been obvious 
for the skilled artisan to have implemented the common delay/suspend Java applet functions of Sani with the invention 
of Purnaveja. The motivation for doing so would have been to continuously display HTML and applet data 
concurrently thereby providing information in an integrated seamless package to client computers. 

Regarding Dependent claim 14, with dependency of claim 9, Purnaveja teaches wherein the markup document 
comprises tag or attribute indication information as the markup image output delay information to control synchronous 
display of output of the markup document with output of the applet (see abstract & column 2, lines 40-55 & fig 9 
numerals 966-965 & column 9, lines 5-65, specifically lines 34-58, including the explanation provided in the 
independent claims). 

Regarding Independent claim 15, A computer system with a display device to display a markup document and a 
linked applet within the markup document, comprising: a presentation engine, which interprets the markup document to 
provide image output information for the markup document; 

and an applet executing engine, which interprets the applet linked to the markup document to provide an applet output, 
wherein the presentation engine delays display of the image output information for the markup document using image 
output delay information used to delay display of the markup document, and included in the applet or the markup 
document, and synchronizes and outputs the delayed image output information of the markup document and the applet 
output to the display device for simultaneous display, when an output control signal indicating completion of rendering 
of the applet output is input from the applet executing engine , and the applet is formed using the Java programming 
language . 

Purnaveja teaches the synchronized display of textual/graphical HTML data with Java applets (see abstract & column 
2, lines 40-55). He teaches the delay of markup image/audio data by using a decoder which buffers the markup data 
(see fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58). He states that "Further, since the video 
and annotation streams are handled synchronously but separately by video decoder 964 and annotation interpreter 
963, respectively, steps 1040 and 1050 can occur concurrently ... "(see column 9, lines 34-40). Although Purnaveja 
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provides a reasonable suggestion for simultaneous display of HTML data with applets he fails to teach the use of delay 
functions within the applet for delaying applet data, instead relying on the interpreter/decoder to display both data 
concurrently further using time markers to display data at a predetermined time, thus including attributes to delay 
markup data display. Sani teaches the use of common Java Applet functions that include delay/suspending of applet 
data (see pg 2, paragraphs 1 & 3 & pg 3, paragraphs 1-2 & pg 4, paragraphs 1-2). He also describes the common applet 
execution states for start, stop and destroy operations using functions (see pg 2, paragraphs 1 & .3). At the time of the 
invention it would have been obvious for the skilled artisan to have implemented the common delay/suspend Java 
applet functions of Sani with the invention of Purnaveja. The motivation for doing so would have been to continuously 
display HTML and applet data concurrently thereby providing information in an integrated seamless package to client 
computers. 



Regarding Dependent claim 16, with dependency of claim 15, Purnaveja teaches wherein the presentation engine 
comprises a buffer to buffer the image output information of the markup document to delay the display of the image 
output information for the markup document, in response to the image output delay signal input from the applet 
executing engine (see abstract & column 2, lines 40-55 & fig 9 numerals 966-965 & column 9, lines 5-65, specifically 
lines 34-58, including the explanation provided in the independent claims). 

Regarding Dependent claim 17, with dependency of claim 15, Purnaveja teaches wherein the presentation engine 
comprises an audio buffer, which buffers audio output, and a video buffer, which buffers video output, of the image 
output information of the markup document and/or of the applet output to delay the display of the image output 
information for the markup document, in response to the output control signal input from the applet executing engine 
(see abstract & column 2, lines 40-55 & fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58, 
including the explanation provided in the independent claims). 



Regarding Dependent claim 18, with dependency of claim 16, Purnaveja teaches wherein the image output delay 
signal is set according to an amount of rendering time of the markup document and/or the applet (see abstract & 
column 2, lines 40-55 & fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58, including the 
explanation provided in the independent claims). 



Application/Control Number: 10/716,868 
Art Unit: 2178 



Page 9 



Regarding Independent claim 19, A computer with a display device to display a markup document image and a 
linked applet image within the markup document image, comprising: a programmed computer processor to control 
synchronous output of the markup document image including a linked applet image to the display device, according to 
display control information in the markup document image and/or in the linked applet image, so that the markup 
document image and the linked applet image are displayed simultaneously as a markup image , wherein the applet is 
formed using the Java programming language . 

Purnaveja teaches the synchronized display of textual/graphical HTML data with Java applets (see abstract & column 
2, lines 40-55). He teaches the delay of markup image/audio data by using a decoder which buffers the markup data 
(see fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58). He states that "Further, since the video 
and annotation streams are handled synchronously but separately by video decoder 964 and annotation interpreter 
963, respectively, steps 1040 and 1050 can occur concurrently , . "(see column 9, lines 34-40). Although Purnaveja 
provides a reasonable suggestion for simultaneous display of HTML data with applets he fails to teach the use of delay 
functions within the applet for delaying applet data, instead relying on the interpreter/decoder to display both data 
concurrently further using time markers to display data at a predetermined time, thus including attributes to delay 
markup data display. Sani teaches the use of common Java Applet functions that include delay/suspending of applet 
data (see pg 2, paragraphs 1 & 3 & pg 3, paragraphs 1-2 & pg 4, paragraphs 1-2). He also describes the common applet 
execution states for start, stop and destroy operations using functions (see pg 2, paragraphs 1 & 3). At the time of the 
invention it would have been obvious for the skilled artisan to have implemented the common delay/suspend Java 
applet functions of Sani with the invention of Purnaveja. The motivation for doing so would have been to continuously 
display HTML and applet data concurrently thereby providing information in an integrated seamless package to client 
computers. 

Regarding Dependent claim 20, with dependency of claim 19, Purnaveja teaches wherein the programmed computer 
processor controls an order of rendering of the markup document image and the linked applet image according to the 
display control information to synchronously and simultaneously display the markup document image and the linked 
applet image as the markup image (see abstract & column 2, lines 40-55 & fig 9 numerals 966-965 & column 9, lines 
5-65, specifically lines 34-58, including the explanation provided in the independent claims). 
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Regarding Dependent claim 21, with dependency of claim 19, Purnaveja teaches wherein the display control 
information is used to suspend an output for display of the markup document image until the markup document image 
and the linked applet image are simultaneously displayable as the markup image (see abstract & column 2, lines 40-55 
& fig 9 numerals 966-965 & column 9, lines 5-65, specifically lines 34-58, including the explanation provided in the 
independent claims). 

// is noted that any citation [fsJJ to specific, pages, columns, lines, or figures in the prior art references and any 
interpretation of the references should not be considered to be limiting in any way. A reference is relevant for all it 
contains and may be relied upon for all that it would have reasonably suggested to one having ordinary skill in the art. 
[[See, MPEP 2123]] 

Response to Arguments 

7. Applicant's arguments filed 10/31/2007 have been considered but are moot in view of the new grounds of rejections. 

Conclusion 
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